Possibility of S = 1 spin liquids with fermionic spinons on triangular lattices 
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In this paper we generalize the fermionic representation for S = 1/2 spins to arbitrary spins. 
Within a mean field theory we obtain several spin liquid states for spin S — 1 antiferromagnets on 
triangular lattices, including gapless f-wave spin liquid and topologically nontrivial p x + ip y spin 
liquid. After considering different competing orders, we construct a phase diagram for the J1-J3-K 
model. The application to recently discovered material NiGa2S4 is discussed. 
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I. INTRODUCTION 

Spin liquids are novel quantum magnetic states where 
long ranged magnetic order is absent at zero tempera- 
ture due to strong quantum fluctuations 1 . Instead of 
spin wave excitations in spin ordered systems, spinons 
are proposed to be the elementary spin excitations in spin 
liquids. It is believed that spin liquid states can be found 
in spin 5=1/2 antiferromagnets(AFMs) on geometric 
frustrated lattices and several promising candidate ma- 
terials have been experimentally discovered 2 . A natu- 
ral question is whether spin liquid states with fermionic 
spinons can also exist in 5 > 1/2 systems as is proposed 
for 5 = 1/2 systems. 

To address this issue, we formulate a fully quantum 
mechanical fermionic mean field theory for 5 = 1 sys- 
tem. We study the Heisenberg AFM, and obtain spin- 
liquid type solutions which have not been proposed pre- 
viously. We focus our interest on the J\-J$-K model, 
which is proposed to be the microscopic Hamiltonian for 
the interesting material NiGa2S4, an frustrated AFM on 
triangular lattice. We argue that a gapless spin liquid 
state obtained in our mean-field theory is a candidate 
for the ground state when compared with experimental 
results. 



II. FERMIONIC REPRESENTATION OF SPIN 

To begin with, we introduce the fermionic represen- 
tation for spins. In the 5=1/2 case, two species of 
fermionic spinons representing up and down spins are in- 
troduced to construct the spin operators. This fermionic 
representation can be generalized to arbitrary spin**, in 
the present paper, we only consider the case 5=1. We 
introduce 3 species of spinon operators c\,cq,C-x satis- 
fying anti-commutation relations {c m ,c^} = S mn , where 
771, n = 1,0, — 1. It is easy to show that spin operators can 
be expressed in terms of c m and c^'s, S = C'lC, where 
C = (ci, Co, c_i) T and I a (a = x, y, z) is a 3 x 3 matrix 
whose matrix elements are given by J^ n = (m\S a \n). 

In this fermionic spinon representation, a constraint 
has to be imposed on the Hilbert space to ensure that 
there is only one fermion per site (particle representation, 



Nf = 1). Alternatively, a spin can equally be represented 
in a Hilbert space with 2 fermions per site (hole represen- 
tation, Nf = 2). The two representations are identical 
for 5 = 1/2, reflecting a particle- hole symmetry of the 
Hilbert space which is absent for 5=1. For 5=1 the 
two representations are related by a symmetry group of 
the spin operators as we shall explain in the following. 

Following Affleck et al£, we introduce the "hole" op- 
erators C — (cLd — Cq,c|) t . It is easy to check that C 
and C behave in the same manner under spin rotation 
and the spin operators can also be written in terms of 
C: S = C'IC. Combining C and C into a 3 x 2 matrix 
ip = (C, (7)2, we can reexpress the spin operator as 



1 



and the constraints can be represented as 
Tr(ipa z ^) = 3 - 2N f = ±1, 



(1) 



(2) 



where +sign for "particle" and —sign for "hole" repre- 
sentations, respectively. 

The spin operator {T]) is invariant under certain trans- 
formation of the spinon operators -0 — > ipW. These 
transformations W form a U(\)®Z2 group (we note that 
for half-integer spins the symmetry group is 5f7(2)«a). 
For 5 = 1/2, the constraint is invariant under the 
SU (2) group because of particle-hole symmetry men- 
tioned above. However, for 5=1 the particle-hole sym- 
metry is absent and the two constraints in Eq.([5]) are not 
invariant under the symmetry group. In fact, the two 
constraints can be transformed from one to the other 
by the particle-hole transformation. We shall adopt the 
"particle" representation Nf = 1 in the following discus- 
sion. 

III. THE EXTENDED HEISENBERG MODEL 

We now apply the fermionic representation to frus- 
trated 2D 5 = 1 spin models. We focus on the J1-J3-K 
model on triangular lattices, 

H = H [ JlS * • S J + K ( S * • + Js E S * ' S J- ( 3 ) 

(id) 

where denotes nearest neighbor (NN) and the 
third nearest neighbors (NNNN). Several semi-classical 
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FIG. 1: (Color online) (a) Two spin liquid ansatzs with dif- 
ferent pairing symmetry, (al) /-wave pairing; (a2) p x + ip y - 
wave pairing, (b) u, v and w are the sublattice index. The 
red arrows symbol the orientation of the spins and the corre- 
sponding (c) The first Brillouin zone of 
triangular lattice. 

mean field studies of this Hamiltonian have appeared 
in literature^ - — where most of the trial ground states 
are unentangled states (or direct product of local states). 
Here we consider a fully quantum mechanical mean field 
theory based on the fermion representation which admits 
resonant valence bond (RVB) type spin liquid ground 
states. We first consider the case K = 0, J\, J3 > 0. 
A. Spin liquid solutions at K = 

Similar to the spin-1/2 systems, the following expres- 
sion also holds for 5 = 1, 

Si • Sj = -^Tr : (V'jV'iV'M) : 

= --(xUij+AlAij): (4) 

where :: denotes normal ordering, Xij = C\Cj = cj-cy + 
c 0i c 0j + C_ xi C-ij is an effective (spin singlet) hopping 

and Ajj = CjCj = C-uC\j — coiCoj + CuC-ij represents 
(S = 1) spin-singlet pairing. A mean field theory can be 
formulated by replacing one of the operators by its ex- 
pectation value, Si-Sj ~ -(xlj{Xij) + &ij{Aij) + h.c.) + 
(Xij) 2 + {Aij) 2 . Notice that (Aji) = — (Ay) and the pair- 
ing has odd parity which is different from the correspond- 
ing S = 1/2 RVB states. We shall first consider solutions 
which respect both translational and rotational symme- 
tries. Two such solutions with /-wave and p x + ip y -w&ve 
symmetries respectively, are obtained^. The mean field 
Hamiltonian of the two states has the form 

H M f = ^^Xk{c\ k ci k + cj fe c fe + cl lfc c_iA;) 

k 

-^[A fe (c_i_ fc cife - ^co-fcCofc) + h.c], 

k 

with Xk = A - Z( JiXilk + J?,X3l2k), A fc = iZ(JiAxiji k + 
J^A^ip2k)- Here Z = 6 is the coordination number, A 
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FIG. 2: (Color online) A first order phase transition between 
two spin liquids occurs at Ji ~ 0.5. We have set Ji + J3 = 1. 
The number on the each line indicates the number of Dirac 
cones of the corresponding state in the first Brillouin zone. 

is the lagrangian multiplier determined by {CjCi) = 1, 
and 7/c = |[cosfc x + cos(-% + ^-) + cos(-%-^-)]. 

= ±[sinfc x +sin(-^ + ^)+sin(-^-^)] and 
^+*Py = i[ s i n fc a; + e^sm(% + ^|^) + e l4 f sin(-^ + 

J 1 * )]- The pairing symmetries for these states on the 
lattice are illustrated in Fig. [IJa). 

The mean field Hamiltonian can be diagonalized with 
appropriate Bogoliubov transformations, and the param- 
eters X) A and A are determined by the self-consistent 
equations, 

xi = (ctc i+x ), X 3 = (cja +2x ), 

A, = (CjC l+x ), A 3 = (CjC t+2x ), 

1 = (cja), (5) 

where i + x denotes a NN site of i and i + 2x a NNNN 
site along the x direction, X\{z) an d A\t$\ are parame- 
ters on NN(NNNN) bonds. Similar to the spin-1/2 mean 
field theory, a physical spin liquid state can be formed 
by Gutzwiller projection of the mean field ground state 
to the state with single occupancy. 

The mean field Hamiltonian describes three branches 
of fermionic spinon excitations with S z = 0, ±1 and iden- 
tical dispersion £7. = \Jx\ + |Afc| 2 - For the /-wave pair- 
ing, the excitation is gapless with several Dirac cones in 
the Brillouin zone (the number of cones is given in Fig. 
[2]). For the p x + ip y -w&ve pairing, the bulk excitation is 
fully gapped. Since Xfc < at the T point, the p x + ip y 
ansatz belongs to the weak pairing region^, and there 
should exist gapless (chiral) Majorana edge modes on 
the open boundaries. Thus the state describes a time- 
reversal symmetry breaking topological spin liquid. The 
Px+ipy state has slightly lower energy in mean-field level. 

Our mean field theory predicts two different spin liquid 
states (for any fixed pairing symmetry) as a function of 
J\j J3. The Px+ipy state remains lower in energy in both 
cases. A first order phase transition occurs at J1/J3 ~ 1. 
When Ji dominates, the spin liquid state is characterized 
by Xi,3 an d Ai,3 ^ (consequently (Si • Sj+i) < 
and (Si • Si+2) < 0); while when J3 dominates, xi = 
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Ai = and ^ 3 ^ 0, A 3 ^ (consequently (S<-Si+i) = 0, 
(S< • S l+2 ) < 0). 

B. Competing orders and the phase diagram 

It is known that the AFM Heisenberg model on tri- 
angular lattice with Ji > 0, J3 = K = has a 120° 
ordered ground state (with wave vector (i, i, 0)). When 
Ji, J3 > 0, the classical ground state is still ordered, but 
with an incommensurate wave vector. The K term gives 
rise to spin nematic order through the identity^ 

(Si-Stf = QfQf , (6) 

where Q af) = ±(S a S + S^S a ) is the spin quadrupole 
tensor. To incorporate these possibilities in our theory, 
we introduce additional decouplings in our mean field 
decomposition. 

To reduce the number of trial parameters in our calcu- 
lation we assume that the long-ranged magnetic order, if 
exist, is always 120° ordered in Hmf- To introduce the 
AFM order, we divide the triangular lattice into three 
sublattices u,v and w as shown in Fig. Hfb). We as- 
sume without loss of generality that the direction of long- 
ranged magnetic order (S a ) (here a G {u,v,w}) is point- 
ing along the new basis axis x a of the a-sublattice (see 
Fig. mb), i.e. M a = (S a ) = <S*)x a = MZ a in the new 
reference frame and becomes an effective ferromagnetic 
order. The operators C(in the old frame) and (7(in the 
new frame) obey the relations C u — C u , C v — e~ lSz6 C v 
and C w = e iS * e C w , where 9 = 2tt/3. Then Eq. Q 
becomes S ai • S bj = - : (xli,bjXai,bj + &li, b j&ai,bj) 
where and (a, b) are the site and sublattice indices 
respectively and 

Xat.bj = e~ l9 c\ al c lbj + 4ai S 0bj + e l9 cl lal c^ lbj , 

A a i,6j — e~ l6 C-iaiCl b j — CQaiCQhj + e l6 ClaiC-Uj, (7) 



for (a, b) e {(u,v), (v,w), (w,u)}. Including the mean 
field decoupling S { ■ Sj ~ (S<) • Sj + Si ■ (Sj) - (Si) ■ (Sj) 
where (S) = Mx, we obtain 

S ai -S bj ~ -[(xxU+AAt. 6 .-Mcos^.)+^.] 
+X 2 + A 2 - M 2 cos 9, (8) 

where x = (Xai,bj) and A = (A al . bj ). 

We next consider the K term. First we observe that 
the K term can be decoupled as K(Si ■ Sj) 2 ~ K'Si ■ Sj, 
where K' = K(Si ■ Sj), and Si ■ Sj can be further decou- 
pled as in (jHJ. This decoupling renormalizes J\. On the 
other hand, the K term may give rise to nematic order 
according to equation © and a corresponding mean field 
decoupling can be introduced in our calculation with 

& ■ S,) 2 ~ (Qf)Qf + Qf(Qf) - (Qf)(Qf). (9) 

We shall assume that (Qf^) is diagonalized in the 
new frame (hence the trial wave function has a 120° ne- 
matic order). So we have (Qf)Qf -> cos 2 9(Q XX )Q XX + 
sm 2 9(Q xx )Qf + sin 2 0(Qf)Qf + cos 2 9{Q\ v )Qf + 

(Qf)Qf- lt is eas y t0 show that Q xx =Sl= 5[l+CoCo+ 
(clc^+cl^)], = S 2 = Hl + clco-iclc.t+cl^t)} 

and Q zz = S 2 = 1 — cjc . Putting together, we obtain 
our mean field decoupling 

K(St • Sj) 2 ~ K'Si ■ Sj + 2K[$N - 1)4^ 

-\W(c* u c_ u + cl u c u ) + | - \N ], (10) 

where N = 1-(Q ZZ ) = (4%) and W = (Q**-QW) = 
(cJjC_ii + cljjCii) are two mean field parameters repre- 
senting nematic order. Notice that No > 1/3 implies easy 
iy-plane anisotropy and nonzero W indicates anisotropy 
of the quadrupole in iy-plane. The total mean field 
Hamiltonian is thus 



Hmf = (- J i + K ') [(XixJ,- + A ^ij ~ M cos + h.c 

(i,3) 

3 1 1 

(2^0 - ^ct.coi - -W(c\iC-ii + SL u cu) 



E [(Xixlj + A 3Alj ~ Mcos9Sf) + h.c 



(11) 



The mean field Hamiltonian can be diagonalized straight- 
forwardly and the self-consistent equations for the mean 
field parameters are similar to Eq. ([5]) except the presence 
of three more order parameters M — (S x ),Nq = (c^coi) 
and W = (c{jC_ii+cLiiCii). We find more than one solu- 
tions to above equations, and the one with lowest energy 
is chosen to be the ground state. The phase diagram(Fig. 



|3} is constructed by finding the mean-field ground states 
with different parameters K/J3 and J1/J3. 

Transitions between different phases are found to be all 
first order. The phase in the bottom of the phase diagram 
with negative K is an easy-plane ferro-nematic phase. In 
this phase, A^o = 1 and xi,3 = Ai, 3 = M = W = 0. All 
spin correlations (Si-Sj) = vanish and ((Si-Si+i) 2 ) = 2. 
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FIG. 3: (Color online) Phase diagram based on the mean 
field theory. All the phase transitions are first order. The two 
spin liquid phases are coexisting with 120° anti-ferro nematic 
order. Insets (A), (B) and (C) show the parameters change 
along the lines of J1/J3 = 1,2 and K = 9 respectively. 

The ground state is a direct product state Y\ i with 
^fl^Pi) = 0- When \K\ becomes smaller, it goes into 
the 120° ordered phase, where M ~ 1, W ~ 0.5, 

Ai, 3 = X1.3 = and (S* • Sj) 0.5 for NN and 

NNNN. When K increases further, there appear two ne- 
matic phases. These are anisotropic spin phases with 
fermionic excitation similar to the two classes of spin liq- 
uids we found when K = except that the spectrum 
is split into three separate branches with two branches 
gapped. The new feature here is that W ^ 0, meaning 
that a 120° AF nematic order is built in (Here 120° AF 
nematic order means that the in-plane easy-axis of Q a ^ 
form 120° angle between any two neighboring sites), and 
the fermionic spinon spectrum is modified. The ground 
state is no longer a spin singlet. 

It should be noted that our mean field ansatz Ijlip is 
not able to include several plausible states, like the mag- 
netic ordering at angles 7^ 120°, or the 90° AFN phase 
proposed frA Therefore, our mean field phase diagram 
should be considered as suggestive only. A more accu- 
rate phase diagram can be obtained only when the above 
plausible states are taken into account and the energies 
are calculated more accurately from, e.g., the Gutzwiller 



projected ground state wave function. Nevertheless, our 
calculation shows the possible existence of spin liquid 
states for spin systems with S > 1/2. The spin liquid 
state can be stabilized (at small K, without AF nematic 
ordering) by the ring exchange interactions^ which are 
not included in our present study. 

IV. DISCUSSION AND CONCLUSION 

Before concluding this paper, we compare our theory 
with the experiment on the recently discovered magnetic 
insulator NiGa 2 S^"ii. In this compound, S = 1 Ni 2+ 
ions form a layered triangular lattice with antiferromag- 
netic (AFM) interaction. The system was found to be in 
a spin disordered state at temperatures down to 0.35K 
despite a Weiss temperature 8w ~ — 80K. The T 2 tem- 
perature dependence of specific heat at low tempera- 
ture (below 10K) indicates that spin excitation is gapless 
while magnetic susceptibility approaches a constant be- 
low lOKii. Several possible ground state have been pro- 
posed and studied^ ' 10 ' 11 ' 19 . Here we propose that the 
/-wave spin liquid state we obtained is a plausible ground 
state. In this case, nodal points appear in the spectrum 
of low lying spin excitations, resulting in T 2 temperature 
dependence of specific heat which is consistent with the 
experiment^. The /-wave state also predicts linear tem- 
perature dependence of spin susceptibility at low tem- 
perature. However it should be noted that the existing 
sample NiGa2S4 is strongly disordered and is presumably 
in a spin-glass state at low temperature. A clean sample 
is desired for better characterization of the material. 

Summarizing, in this paper we have generalized the 
fermionic representation of S — 1/2 spins to spins with 
arbitrary magnitude. A mean field theory is developed 
for a S — 1 spin model where several spin liquid solutions 
are obtained. We have also obtained a AF-nematic state 
with fermionic spinon excitations. Our approach opens 
the possibility of constructing new classes of spin states 
for systems with spin magnitude S > 1/2. 
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